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HIGHLIGHTS 


•  Investigation  of  the  model-based 
optimal  energy  management  of  a 
fuel-cell  hybrid  vehicle. 

•  Vehicle  equipped  with  battery  and 
ultracapacitor  hybrid  storage  system. 

•  Development  of  multi-dimensional 
dynamic  programming  code  for  2- 
DOF  energy  management  problem. 

•  Determination  of  maximum  potential 
of  using  hybrid  storage  in  reducing 
fuel  consumption. 

•  Hybrid  storage  improved  fuel  con¬ 
sumption  especially  in  acceleration 
and  braking. 
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Hybrid  storage  systems  consisting  of  battery  and  ultra-capacitor  have  recently  emerged  as  an  alternative 
to  the  conventional  single  buffer  layout  in  hybrid  vehicles.  Their  high  power  and  energy  density  could 
improve  the  performance  indices  of  the  vehicle,  provided  that  an  optimal  energy  management  strategy  is 
employed  that  could  handle  systems  with  multiple  degrees  of  freedom  (DOF).  The  majority  of  existing 
energy  management  strategies  is  limited  to  a  single  DOF  and  the  small  body  of  work  on  multi-DOF 
systems  is  mainly  heuristic-based. 

We  propose  an  optimal  solution  to  the  energy  management  problem  in  fuel-cell  hybrid  vehicles  with 
dual  storage  buffer  for  fuel  economy  in  a  standard  driving  cycle  using  multi-dimensional  dynamic  pro¬ 
gramming  (MDDP).  An  efficient  MDDP  code  is  developed  using  MATLAB™’s  vectorization  feature  that  helps 
reduce  the  inherently  high  computational  cost  of  MDDP.  Results  of  multiple  simulated  experiments  are 
presented  to  demonstrate  the  applicability  and  performance  of  the  proposed  strategy.  A  comparison  is  also 
made  between  a  single  and  a  double  buffer  fuel-cell  hybrid  vehicle  in  various  driving  cycles  to  determine 
the  maximum  reduction  in  fuel  consumption  that  can  be  achieved  by  the  addition  of  an  ultra-capacitor. 

©  2013  Elsevier  B.V.  All  rights  reserved. 


1.  Introduction 

One  of  the  achievements  of  modern  engineering  is  improve¬ 
ment  in  the  performance  of  existing  systems  by  replacing  the 
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internal  components  and  updating  subsystem  technology  with  the 
help  of  computer  software  and  simulation  packages.  This  branch  of 
engineering  is  associated  with  design  study  and  optimization  and 
its  main  challenge  is  prediction  of  enhancement  in  system  attribute 
arising  from  changes  in  system  parameters. 

In  the  face  of  a  constant  stream  of  criticisms,  hybrid  vehicles 
(HVs)  enjoy  a  growing  popularity  within  the  engineering 
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community  and  among  consumers  alike.  The  introduction  of  newer 
powertrain  layouts  has  considerably  improved  the  performance  of 
HVs  and  enabled  them  to  meet  the  increasingly  strict  environ¬ 
mental  regulations  and  economic  considerations.  The  inevitable 
transition  from  conventional  powertrains  to  those  that  rely  less  on 
fossil  fuels  justifies  the  extensive  research  on  hybridization  tech¬ 
nology  that  is  underway  both  in  industry  and  in  academia. 

The  use  of  auxiliary  energy  sources  in  HVs  leads  to  additional 
degrees  of  freedom  in  power  distribution.  This  means  that  the 
performance  of  a  hybrid  vehicle  largely  depends  on  the  efficiency  of 
the  energy  management  strategy  employed.  Devising  an  efficient 
energy  management  strategy  involves  the  solution  of  a  dynamic 
optimization  problem  wherein  such  cumulative  quantities  as  fuel 
consumption  constitute  the  cost  function  and  the  power  distribu¬ 
tion  profile  among  various  sources  (as  a  function  of  time)  forms  the 
design  variable  set.  That  is,  the  optimal  power  management  can  be 
formulated  as  finite-horizon  nonlinear  optimal  control  problem. 

Of  the  various  reported  techniques  to  solve  the  above  control 
problem,  dynamic  programming  (DP)  is  one  of  the  most  popular.  It 
guarantees  the  optimality  of  the  solution  found  for  a  given  toler¬ 
ance;  its  mathematical  foundations  are  straightforward;  and  it 
could  be  easily  implemented  in  a  concise  computer  code.  But 
dynamic  programming  has  some  shortcomings,  too.  It  requires  a 
variety  of  algorithms  to  tackle  the  numerical  problems  and  is  case- 
dependent.  But  the  main  drawback  is  well  known  Bellman’s  the 
“curse  of  dimensionality”,  the  computational  cost  increases  expo¬ 
nentially  with  the  number  of  variables  (state  and  control)  [1].  Also 
the  interpolation  problem  arising  from  a  misplaced  state  trajectory 
and  grid  points  poses  a  major  challenge. 

Using  the  code-vectorization  feature  of  MATLAB  to  avoid  itera¬ 
tive  loop  structures,  a  generic  and  computationally  efficient  algo¬ 
rithm  is  presented  here  for  MDDP  problems.  A  general  approach  to 
the  optimal  energy  management  is  adopted  throughout  the  article, 
and  a  fuel-cell  hybrid  vehicle  (FCHV)  is  considered  as  a  case  study. 
Many  researchers  declared  fuel  cell  technology  as  a  high-chance 
candidate  to  replace  combustion  engines  in  cars  in  nearly  future  [2]. 

Up  to  now,  few  papers  have  evaluated  the  fuel  economy 
potential  of  the  fast  ultra-capacitor  and  traditional  battery  combi¬ 
nation.  These  few  works  only  focused  on  heuristic  controllers.  The 
main  contribution  of  this  paper  is  to  report  the  solution  of  optimal 
two  DOF  energy  management  problem  and  investigating  the 
applicability  of  DP  to  multi-dimensional  problems.  By  developing  a 
new  solver  based  on  vectorized  multi-dimensional  dynamic  pro¬ 
gramming,  the  possibility  to  solve  more  problems  in  this  field 
afforded.  Also  by  assembling  DP  kernel  and  hybrid  vehicle  simu¬ 
lator,  an  integrated  user  interface  presented  for  interested 
researchers. 

2.  Structure  of  the  article 

The  overall  objective  of  this  study  is  to  evaluate  the  effect  of  a 
hybrid  storage  system  on  the  performance  of  a  Hybrid  Electric 
Vehicle.  Generally,  the  simultaneous  use  of  batteries  (high-specific- 
energy)  and  ultra-capacitors  (high-specific-power)  leads  to  per¬ 
formance  improvement  of  the  HEV  [3],  but  the  implementation 
costs  are  unaffordably  high.  For  an  accurate  feasibility  assessment 
of  using  a  hybrid  storage  in  practical  applications,  the  tradeoff 
between  the  advantages  (including  reduced  fuel  consumption, 
improved  acceleration  and  braking,  and  reduced  main  storage 
capacity)  and  disadvantages  (including  implementation  and 
maintenance  considerations,  increased  hardware  complexity,  and 
additional  cost  of  interface  components)  of  the  hybrid  layout 
should  be  carefully  studied. 

In  this  study,  the  optimal  power  distribution  profile  to  achieve 
minimum  fuel  consumption  in  a  fuel  cell  hybrid  vehicle  with  hybrid 


storage  is  determined  in  a  standard  driving  cycle.  The  minimum 
fuel  consumption  is  a  comprehensive  and  practical  indicator  for 
evaluating  the  hybrid  storage  system.  To  use  the  maximum 
potential  of  system  in  reduction  of  fuel  consumption,  an  indepen¬ 
dent  degree  of  freedom  in  power  distribution  is  considered  for  each 
storage  element. 

To  achieve  this,  first  a  standard  driving  cycle  profile  is  consid¬ 
ered  and  fed  to  an  inverse  model  of  vehicle  dynamic  and  electric 
motor  to  calculate  the  power  demand  from  propulsion  system. 
Then  a  simple  model  of  the  powertrain  has  been  developed,  which 
can  be  used  for  applications  such  as  control  analysis  and  design  and 
parametric  studies.  This  model  has  two  state  variables  (battery  and 
ultra-capacitor  state  of  charge),  two  control  inputs  (fuel  cell  and 
ultra-capacitor  power)  and  external  disturbance  as  a  function  of 
time  (driving  cycle  power  request  from  the  propulsion  system). 
Now  the  energy  management  problem  is  formulated  as  a  finite- 
horizon  nonlinear  optimal  control  with  bounded  states  and 
control  variables.  The  optimal  control  problem  is  solved  using 
multi-dimensional,  vectorized  dynamic  programming  imple¬ 
mented  in  MATLAB.  The  cost  functional  includes  charge  sustenance 
(equal  energy  level  of  storage  at  the  beginning  and  end  of  the  cycle) 
and  fuel  consumption.  This  structure  simulated  in  variety  of  driving 
cycles  and  the  performance  of  fuel  cell  hybrid  vehicle  with  simple 
and  dual  storage  is  compared,  so  the  maximum  potential  of  the  fuel 
economy  by  adding  fast  storage  (ultra-capacitor)  is  assessed. 

This  research  provides  the  foundation  for  model-based  studies 
of  fuel  cell  hybrid  vehicles  which  has  wide  applications  and  covers  a 
range  of  issues  such  as  sizing  and  optimization  of  components  and 
control  strategies  development  and  evaluation.  By  using  MATLAB,  a 
graphical  user  interface  was  developed  that  automate  problem 
analysis.  Based  on  developed  tool,  the  possibility  of  using  hybrid 
storage  in  fuel  cell  hybrid  vehicle  was  studied. 

3.  Literature  survey 

This  section  reviews  the  major  studies  in  the  field  of  energy 
management  in  hybrid  vehicles  and  in  particular  deals  with  the 
optimal  energy  management  in  fuel  cell  hybrid  vehicles  based  on 
dynamic  programming.  This  review  focused  on  vacuity  existing  in 
the  field  of  multi-dimensional  optimal  control  in  energy  manage¬ 
ment  problems.  See  Ref.  [4]  for  supplementary  studies. 

3.1.  Energy  management 

The  term  “energy  management”  in  the  literature  refers  to  how 
road  load  distributes  between  different  energy  sources  while 
satisfying  design  requirements  (fuel  consumption,  pollution).  There 
are  two  main  categories,  heuristic  and  optimal,  proposed  to  solve 
energy  management  problems  [4].  Heuristic  methods  used  for  real¬ 
time  applications,  and  despite  the  high  sensitivity  to  rule-base 
tuning,  they  offer  acceptable  performance.  On  the  contrary,  the 
optimal  approaches  are  based  on  the  minimizing  a  cost  function. 
These  methods  are  typically  model-based  and  therefore  scalable 
and  extensible.  Computational  burden  is  much  higher  with  the 
offline  optimal  methods  compared  with  the  online  heuristic 
methods. 

The  optimal  strategies  in  energy  management  are  divided  into 
instantaneous  optimization  and  finite-horizon  optimization  and 
widely  used  in  design  of  supervisory  control  [5].  Instantaneous 
methods  provide  power  flow  for  real-time  applications  based  on 
local  criteria.  Finite-horizon  methods  include  dynamic  indexes 
such  as  energy  consumption  during  a  priori  known  driving  cycle 
and  despite  offering  the  global  optimal  solution,  they  cannot 
implemented  in  real-time  applications,  because  of  need  to  non- 
causal  knowledge  of  the  automotive  motion  situation  in  the 
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future.  Because  of  the  time  and  state  dependent  parameters  and 
nonlinear  effects,  this  problem  belongs  to  finite-horizon  nonlinear 
optimal  control  with  constrained  state  and  control. 

Guzzella  et  al.  [4]  comprehensively  studied  hybrid  vehicles  and 
energy  management.  They  overviewed  various  methods  of  hybrid 
vehicle  control  that  includes  two  main  topics,  “Optimal  Energy 
Management”  and  “Real-Time  Implementation”  and  alluded  to  the 
research  background,  the  present  work  and  trends  of  future 
research.  Perez  studies  the  energy  management  problem  in  a  global 
coordinate  and  independent  of  vehicle  layout  and  the  formulation 
presented  is  applicable  to  various  configurations  of  vehicle  [6]. 

3.2.  Energy  sources 

Typically  the  structure  of  the  hybrid  vehicle  powertrain  consists 
of  two  main  elements:  the  primary  power  source  (one-way  energy 
conversion  unit)  and  the  secondary  power  source  (bi-directional 
energy  buffer).  The  storage  device  provides  the  ability  to  recovering 
brake  energy,  increase  of  power  in  acceleration  mode  and  avoiding 
engine  work  in  low-efficiency  region.  Various  tools  are  used  as 
energy  storage  device  that  two  important  parameters,  the  specific 
power  and  energy  are  used  to  characterize  them.  An  ideal  storage 
should  have  high  energy  storage  and  fast  energy  release 
capabilities. 

The  battery  plays  role  of  storage  in  most  of  hybrid  vehicles. 
Meanwhile  the  main  problem  with  conventional  batteries  is  high 
sensitivity  to  the  rate  of  power  which  causes  limitation  in  energy 
storage  and  retrieval  performance  and  therefore  they  cannot  offer 
good  performance  in  acceleration  and  deceleration  circumstances. 
Other  challenge  in  batteries  is  limitations  due  to  working  cycles, 
which  highly  affected  their  life  and  durability.  Ultra-capacitor  located 
on  the  opposite  side  and  can  work  in  high  power  and  frequency 
situation  and  infinite  number  of  working  cycle.  The  use  of  ultra¬ 
capacitor  is  not  bug-free  and  it  imposed  electronic  interface  ele¬ 
ments  to  the  system,  thereby  increasing  the  overall  cost  of  system, 
increased  complexity  and  special  considerations  in  maintenance. 

Combining  two  or  more  storage  sources  of  energy  is  one  way  to 
achieve  the  ideal  Hybrid  Storage  System  so  they  Undermine 
shortcomings  and  reinforce  advantages  of  each  other  [2  .  One  of  the 
common  patterns  of  idealized  storage  that  generally  used  in  hybrid 
electric  vehicles  is  combination  of  a  fast  buffer  (ultra-capacitor)  to 
aid  main  buffer  (battery)  and  cover  its  deficiency.  The  battery  and 
ultra-capacitor  combined  system  has  high  performance  and  low 
weight  and  size  and  so  it  is  proper  for  use  in  fuel  cell  hybrid  vehicles 
[7].  Also,  the  proper  rating  between  these  two  elements  has  an 
important  impact  on  system  performance. 

3.3.  Application  of  hybrid  storage 

There  are  numerous  applications  of  battery  and  ultra-capacitor 
dual  storage  system  seen  in  literature,  which  mainly  include  early 
studies  and  they  more  or  less  focused  on  the  feasibility  and 
implementation  considerations  [8].  There  exist  different  configu¬ 
rations  of  multiple  sources  used  in  vehicle.  For  example,  use  of 
three  sources  composes  of  fuel  cells,  ultra-capacitor  and  solar  cells 
[9]  or  multiple  sources  based  on  combustion  engines,  battery  and 
photo- voltaic  source  10]. 

Hybrid  storage  systems  typically  consist  of  sources  with 
different  time  constants.  Accordingly,  it  can  be  interpreted  that  in  a 
hybrid  vehicle,  the  prime  mover  provide  DC  component  of  power 
while  buffer  is  responsible  for  providing  the  fluctuations  around 
the  mean  value,  Hence  it  prevent  the  working  points  of  main  source 
to  move  away  from  its  optimal  range  [3].  In  Ref.  [11  energy  man¬ 
agement  in  a  fuel  cell  vehicle  with  hybrid  storage  (batteries  and 
ultra-capacitors)  performed  using  fuzzy  logic. 


Unfortunately,  the  optimal  control  problem  in  hybrid  vehicles 
with  more  than  two  energy  sources  is  not  solved  and  the  existing 
work  in  this  area  is  usually  based  on  heuristic  structures. 

In  most  studies  on  hybrid  vehicles  with  hybrid  storage,  the  same 
approach  as  with  simple  storage  is  used,  in  other  words,  in  the 
storage  assembly,  battery  plays  role  of  primary  source  and  the 
ultra-capacitor  plays  the  role  of  an  auxiliary  buffer.  With  this 
attitude,  the  problem  of  energy  management  deals  with  only  one 
degree  of  freedom  in  power  distribution  and  firstly,  the  supervisory 
control  is  designed  independently  based  on  primary  source  and 
battery  and  then  a  fraction  of  battery  power  allocated  to  ultra¬ 
capacitor  based  on  a  local  controller.  For  example  to  control 
power  between  three  energy  sources,  Yu  presented  a  two-level 
control  strategy  [8].  He  used  a  primary  controller  to  distribute 
power  between  fuel  cells  and  batteries  and  a  secondary  controller 
that  ultra-capacitor  help  the  battery. 

Unlike  the  above  approach,  in  the  present  study,  battery  and 
ultra-capacitor  considered  independently  and  each  has  its  own 
degree  of  freedom  in  the  power  distribution.  Fortunately  this 
approach  has  been  approved  in  Ref.  [12  .  This  reference  acknowl¬ 
edged  that  without  changing  control  strategy  of  primary  power 
source,  the  use  of  ultra-capacitor  source  cannot  provide  significant 
improvement  in  fuel  consumption.  This  reference  has  provided 
rules  for  the  optimal  power  management  by  studying  the  role  of  an 
ultra-capacitor  in  fuel  consumption  of  a  fuel  cell  hybrid  vehicle, 
upon  which  the  battery  is  responsible  for  fuel  cell  power  man¬ 
agement  and  Ultra-capacitor  is  responsible  for  battery  power 
management.  Based  on  the  results  of  this  reference,  the  control 
strategy  has  an  effective  role  in  performance  and  sizing  of  system. 
Of  course  this  article  states  that  the  appropriate  control  strategy 
has  a  great  impact  on  the  sizing  of  components,  but  its  effect  on 
system  performance  (acceleration,  fuel  consumption)  is  lower. 

In  Ref.  [13  the  optimal  solution  of  energy  management  (with 
two  controls  and  three  states)  has  been  evaluated  in  several  driving 
cycles,  and  the  potential  to  reduce  fuel  consumption  in  these  cycles 
has  been  investigated.  Due  to  the  large  amount  of  calculations,  this 
problem  is  reduced  to  three  simpler  problems  and  solved  using 
dynamic  programming.  The  structure  of  this  hybrid  vehicle  consists 
of  a  conventional  combustion  engine  and  a  flywheel  as  an  energy 
buffer. 

Kum  [5]  presents  one  of  the  few  works  that  used  MDDP  with 
continuous  variables.  In  this  reference  the  cost  function  include  fuel 
consumption  and  emissions.  In  this  paper,  in  addition  to  the  battery 
state  of  charge  which  is  usually  used  in  energy  management  studies 
to  include  battery  dynamic,  the  catalyst  temperature  is  considered 
to  include  the  thermal  dynamics  of  the  catalyst.  This  study  devel¬ 
oped  a  systematic  method  to  design  the  cold-start  supervisory  al¬ 
gorithm.  Then  some  rules  are  extracted  for  real-time  applications, 
which  accelerating  the  warming  of  catalyst  tends  to  reduction  in 
pollution  of  engine  when  working  in  cold  conditions.  Also  a  two¬ 
mode  hybrid  electric  vehicle  that  has  two  state  variables  (battery 
state  of  charge  and  speed  of  combustion  engine)  considered  on  a 
combined  series-parallel  arrangement  [14]. 

3.4.  Dynamic  programming 

In  recent  years  the  dynamic  programming  is  used  to  solve 
various  dynamic  optimization  problems  in  vehicle  such  as  deter¬ 
mining  the  optimum  strategy  of  gear  shifting  [15],  determine  the 
optimal  topology  of  driveline  [16],  design  of  power  split  device  [17], 
and  reduction  of  trip  time  [18  .  One  of  the  systematic  applications 
of  dynamic  programming  (single  state  single  input)  is  solving 
optimal  energy  management  problem  in  hybrid  vehicles.  Of  course 
some  multi-dimensional  problems  solved  with  single  control  single 
state  (SCSS)  dynamic  programming  with  help  of  special  tricks.  For 
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example  Ngo  has  been  used  dynamic  programming  to  control  gear 
shifting  in  a  parallel  hybrid  vehicle  [19].  This  type  of  problem 
belongs  to  integer  programming  and  includes  two  state  variables 
(gear  position  &  engine  on-off  condition)  and  one  control  variable 
(gear  shift  command).  Romaus  considered  the  optimal  energy 
management  problem  of  an  electric  car  with  hybrid  storage 
(batteries  and  ultra-capacitors)  and  solved  it  by  using  stochastic 
dynamic  programming  and  claims  that  this  combination  severely 
reduces  storage  losses  [20]. 

3.5.  Computational  cost 


The  aim  of  a  hybrid  control  strategy  is  how  to  instantaneously 
distribute  the  power  on  primary  energy  source  and  electrical 
accumulator  to  satisfy  the  road  load  power  requirement  while 
meeting  the  instantaneous  and  global  constraints  and  objectives. 
The  energy-balance  equation  is  the  starting  point  of  each  energy 
management  study,  which  the  different  sources  contribute  to 
provide  demand  power: 


Fuel-Ceils  Electric  Motor  Battery  Ultra -Capacitor  ( 1  ) 

Primary  Source  Road  Load  Demand  Hybrid  Accumulator 


Solving  multi-input  multi-state  energy  management  problems 
by  dynamic  programming  is  theoretically  possible,  but  practically  is 
very  difficult  due  to  high  computational  cost,  and  unfortunately 
few  cases  have  been  reported  in  the  literature.  In  this  regard  DP  can 
be  used  to  solve  long  missions  only  with  small  amount  of  variables 
[4].  Perez  reported  that  computational  cost  is  a  deterrent  issue  for 
problems  with  more  than  one  dimension  and  points  out  that  by 
adding  an  additional  state  (such  as  addition  of  ultra-capacitor 
bank),  the  computational  cost  becomes  a  major  obstacle  [6]. 

Some  of  the  works  such  as  Ref.  [21]  is  mixed  integer  program¬ 
ming  problem  that  despite  being  a  multi-input  multi-state,  the 
additional  variables  are  of  integer  type  (the  [22]  refers  to  ways  for 
converting  these  problems). 

Musardo  [23]  mentioned  several  hours  of  computing  time  to 
solve  the  optimal  control  in  a  cycle  (such  as  FUDS)  by  using 
dynamic  programming  on  a  Pentium  IV.  Also  Kang  [24]  referred  to 
time  about  one  month  for  simulation  of  a  problem  with  two  state 
variables  in  the  NEDC  cycle  and  on  the  Pentium  II.  The  energy 
management  problem  with  dual  storage  buffer  has  been  consid¬ 
ered  in  Ref.  [22].  This  reference  acknowledged  that  the  problem 
cannot  be  solved  in  limited  time  when  there  exist  two  state 
variables.  Referring  to  the  shortcomings  of  dynamic  programming, 
Asbogard  [25]  talks  about  little  hope  for  considering  more 
dynamics  (such  as  battery  life  and  engine  thermal  dynamics). 

However  all  of  these  cases  acknowledged  the  high  computa¬ 
tional  cost  of  MDDP,  which  tends  to  implementation  difficulties. 

4.  Vehicle  arrangement 

A  general  high  level  model  as  shown  in  Fig.  1  is  used  and  related 
elements  are  connected  to  each  other  based  on  power  flow.  To 
connect  these  systems,  power  electronic  equipment  such  as  power 
converters  and  inverters  are  required  [26],  but  the  implementation 
details  of  the  sources  ignored  due  to  variety  of  configurations  and 
hardware  complexity.  This  research  used  an  FCHV  comprises  of 
fuel-cells  and  a  combined  battery  and  ultracapacitor  accumulator. 
The  electric  energy  produced  by  these  sources  drive  an  electric 
motor  that  in  turn  propel  the  car.  The  required  data  for  a  case  study 
(proportional  to  a  medium-size  passenger  sedan)  are  collected 
from  authorized  references. 


Fig.  1.  Schematic  arrangement  of  powertrain. 


5.  Modeling 

This  section  briefly  describes  models  of  hybrid  vehicle  sub¬ 
systems  based  on  existing  rich  literature.  Guzzella  [27]  has  sys¬ 
tematically  surveyed  different  modeling  approaches  for  vehicle 
longitudinal  dynamic  and  powertrain  in  forward  dynamic  and 
inverse  quasi-static  form.  In  addition,  he  has  presented  a  modeling 
tool  for  powertrain  of  hybrid  vehicles  using  quasi-static  approach. 

The  models  used  in  energy  management  applications  normally 
have  lumped  and  time  invariant  parameters  and  they  are  repre¬ 
sented  mathematically  in  constant  coefficient  differential-algebraic 
equation  (DAE)  form.  Sometime  these  parameters  depend  on  sys¬ 
tem  state  variables,  which  in  quasi-static  models,  the  look-up  table 
and  experimental  data  fitting  are  used  to  describe  the  component’s 
complexity.  Each  look-up  table  is  a  nonlinear  mapping  between 
operational  variables  and  system  parameters.  These  mappings  are 
measured  at  steady-state  conditions  so  their  transient  behaviors 
ignored. 

In  this  research  only  the  dynamic  of  storage  buffer  has  been 
considered  so  the  other  components  were  modeled  in  quasi-static 
manner  and  based  on  power  split  approach.  So  the  components 
modeled  with  respect  to  efficiency  and  compatible  with  power  flow 
requirements. 

5.1.  Vehicle  mechanical  dynamics 

5.1.1.  Driving  cycle 

Driving  cycle  is  a  standard  velocity  profile  originated  from  the 
realistic  driving  pattern  and  one  of  its  applications  is  evaluation  and 
certification  of  automotive  fuel  consumption  and  emissions.  Each 
driving  cycle  used  to  simulate  a  specific  driving  condition,  for 
instance,  UDDS  represents  urban  driving  for  lightweight  vehicles. 
In  researches  related  to  fuel  consumption,  vehicle  is  driven  along  a 
driving  cycle  which  considered  as  a  priori  known  disturbance  to 
energy  management  problem. 

The  standard  driving  cycle  has  an  important  role  on  optimal 
energy  management  result  in  hybrid  vehicles.  For  example, 
supervisory  control  in  a  short  driving  cycle  with  low  power  request 
and  no  charge  sustenance  restriction,  converges  to  trivial  solution 
that  all  required  power  supplied  only  by  the  buffer  source.  Of 
course  because  of  losses  in  vehicle  and  its  components,  charge 
sustaining  constraint  always  forces  primary  power  source  to  deliver 
some  fraction  of  power  (at  least  equal  to  lost  power). 

In  this  research,  five  driving  cycles  have  been  used  in  simulation 
to  reflect  different  operating  conditions  of  vehicle,  including  ECE- 
15  (low  speed  urban  run),  NYCC  (low  speed  low  run),  EUDC 
(urban  running),  SFTP  (high  speed  high  acceleration  running)  and 
NEDC  (dynamometer  test  Emissions  evaluation). 

5.1.2.  Vehicle  longitudinal  dynamics 

Among  the  direct  or  inverse  vehicle  dynamic  modeling,  in  most 
of  the  researches  on  energy  management,  the  inverse  approach  is 
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used.  In  inverse  model,  velocity  and  acceleration  are  inputs,  while 
these  quantities  considered  as  state  in  forward  models  and  so  it 
needs  to  driver  model  to  follow  driving  cycle. 

In  this  research,  the  inverse  model  of  longitudinal  vehicle 
dynamic  is  used  and  its  data  represented  in  Table  1.  By  using  a  priori 
known  driving  cycle  and  solving  inverse  vehicle  dynamic,  the 
corresponding  road  power  is  calculated  and  after  passing  through 
driveline,  the  power  demand  from  powertrain  is  determined  [28]. 
This  demand  power  must  be  corrected,  because  it  might  be  out  of 
component  capacity.  For  instance,  the  accelerating  power  might  be 
more  than  the  power  of  both  primary  and  buffer  sources,  or  the 
braking  power  may  exceeds  the  amount  that  can  be  absorbed  by 
storage  element. 

This  model  is  constructed  based  on  the  balance  of  forces  acts  in 
longitudinal  direction  [2].  The  applied  forces  acting  on  vehicle  are 
composed  of  two  components:  tire  traction  forces  (originated  from 
powertrain  and  brake)  and  resistance  forces  (road  load)  which  their 
difference  tends  vehicle  to  accelerate.  Vehicle  resistance  forces 
consist  of  aerodynamic  drag,  rolling  resistance  and  uphill  driving 
force  that  in  general  are  function  of  velocity. 

=  ]Cft  -  Efr  =  mv 

Traction  Road  Resistance  Inertial 

& 

Fr(v)  =  Fr  +  Fa  +  Fg  (2) 

=  Mr™&Cos(</>)  +  0.5  paCdAfv2  +  mgSin(</>) 

Pt  =  Ftv  =  Fr(v)v  +  mvv 

The  Pt  is  tractive  power  satisfying  conditions  of  vehicle  motion. 

5.1.3.  Regenerative  brake 

In  hybrid  vehicles,  some  fraction  of  the  braking  energy  (wasted 
in  conventional  vehicles)  can  be  recovered  by  operating  the  motor 
drive  as  a  generator  and  restoring  it  into  the  power  storage  [2  .  Of 
course  the  regeneration  process  depends  on  velocity  and  deceler¬ 
ation,  structure  of  brake  and  generator,  and  ability  of  battery  in 
energy  absorption.  Before  passing  braking  power  through  the 
generator,  a  constant  efficiency  (50%)  is  used  for  modeling  regen¬ 
erative  braking  [29].  In  heavy  braking  conditions,  auxiliary  me¬ 
chanical  braking  system  is  required.  In  this  research,  mechanical 
braking  has  not  modeled. 

5.1.4.  Axle  Ff  transmission 

After  the  power  produced  by  powertrain  passes  through  electric 
machine,  delivered  as  mechanical  power  to  driveline  and  wheels 
(and  vice  versa).  The  collection  of  driveline  components  (includes 
motor  transmission,  final  drive  and  wheels)  which  are  located  after 
electric  machine,  modeled  as  a  static  ratio. 


machine  model  to  determine  demand  power  from  powertrain.  The 
general  parameters  of  axle  represented  in  Table  2. 

5.2.  Electric  machine 


There  is  a  wide  range  of  electric  machines,  which  [2]  has  pre¬ 
sented  a  general  classification.  Traction  motors  such  as  Standard 
DC,  Induction  AC  and  Brushless  DC  with  a  maximum  power  range 
of  20—50  kW,  are  used  in  hybrid-electric  vehicles.  Due  to 
complexity  of  these  systems,  a  wide  range  of  models  has  been 
presented  in  literature.  In  most  references,  steady  state  motor 
model  is  used  as  an  initial  effort  for  control  applications,  and  the 
motor  considered  as  a  static  block  associated  with  power  losses 
[27].  These  power  losses  are  presented  as  algebraic  relations  or 
lookup  tables.  In  this  paper,  a  quasi-static  model  has  been  used 
based  on  the  efficiency  map  shown  in  Fig.  2  [28].  Other  parameters 
represented  in  Table  3  (adapted  from  ADVISOR™  Library). 

Vm  =  Vm  (“Jin)  (4) 

Model  inputs  are  angular  velocity  and  requested  torque  from 
tire  and  output  is  the  power  necessary  to  produce  requested  torque. 


Tmoj 

vi 


(5) 


5.3.  Storage  buffer 

Buffer  is  a  key  element  in  energy  management  which  improves 
stability,  reliability  and  quality  of  primary  power  sources.  In  most  of 
energy  management  studies,  buffer  elements  are  the  only  consid¬ 
ered  dynamic,  so  the  modeling  of  these  elements  discussed  in  more 
details.  Sometimes  it  is  exaggerated  that  battery  is  energy  reservoir 
while  ultra-capacitor  is  power  reservoir.  As  a  rule  of  thumb,  ultra¬ 
capacitor  supplies  power  more  efficiently  than  batteries,  assuming 
equal  power  density  [12  .  Due  to  similar  application,  there  are  great 
similarities  in  modeling  of  these  elements.  Flere  a  common  tem¬ 
plate  based  on  equivalent  circuit  is  used  to  model  these  two  com¬ 
ponents,  which  has  the  same  structure  and  similar  inputs  and  state 
variables  and  provide  sufficient  accuracy  for  design  study  and 
control  applications. 

In  great  deals  of  initial  estimate  to  energy  management 
problems,  the  dynamic  of  storage  considered  simply  as  an  inte¬ 
grator  of  input  while  terminal  power  and  state  of  charge 
respectively  considered  as  model  input  and  state.  Nonetheless 
for  energy  management  purposes  between  these  two  elements, 
the  time  constant  and  losses  should  involve  in  the  model 
because  various  integrators  treated  as  an  equivalent  integrator 
by  solver. 


Nr 

0 


0 

Nr1 


Nd 

0 


0 


0 

Fw 


(3) 


Reduction  Gear  Differential 


Wheel 


The  above  equation  relates  flow  and  effort  components  of  power 
between  electric  machine  and  driving  cycle,  which  is  fed  to 


Table  1 

General  vehicle  data. 


SAMAND  (Iran  National  Car  from  IKCo  Brochure) 


Total  mass 

m 

1080  kg 

Frontal  area 

Af 

2  m2 

Drag  coefficient 

cd 

0.51 

Rolling  resistance 

Mr 

0.009 

Air  density 

Pair 

1.202  kg/nr 

5.3.1.  State  of  remainder 

In  order  to  show  the  amount  of  supply  in  the  storage,  the 
state  of  charge  quantity  is  used,  which  present  the  correlation 
between  existing  charge  and  storage  capacity.  This  quantity  is  an 
important  operational  indicator  in  hybrid  vehicles  and  the  per¬ 
formance  of  storage  system  take  its  maximum  in  the  middle  of 
this  interval  (0.4-0.6).  Theoretically  SOC  is  a  normalized 
dimensionless  unit  (between  0  and  1),  but  in  practice  an  upper 


Table  2 

Parameters  of  axle  (wheel  and  gearbox). 

SAMAND  (Iran  National  Car  from  IKCo  Brochure) 

Wheel  radius  Rw  0.33  m 

Final  drive  ratio  Nd  4.07 

Reduction  gear  ratio  Nr  1 .6 
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S  =  ®(S,P) 

(r  _  Remaining  Charge c  _  *(0  _  P(t)  \  ^) 

C  ~  Capacity  ^  _  Qmax  _  QmaxV(t)  J 

Since  the  terminal  power  is  input  of  storage  model,  the  current 
(or  voltage)  of  terminal  should  be  calculated  based  on  it.  Looking 
at  Fig.  3  and  using  the  Kirchhoff  s  law  (KVL),  the  circuit  current  is 
determined. 


-60 

Fig.  2.  Spatial  map  of  electric  machine  efficiency. 


references”,  positive  terminal  power  is  corresponding  to  buffer 
charging.  Since  the  terminal  voltage  is  positive,  the  direction  of 
current  depends  on  the  sign  of  terminal  power. 

Based  on  the  existing  idealized  models,  charge  process  of  these 
two  elements  is  completely  different.  Charging  the  ultra-capacitor, 
increase  its  voltage  until  the  voltage  balances  with  external  voltage 
and  current  flow  diminished,  while  in  the  battery  charging  process, 
current  and  so  on  charge  level  continues  permanently.  So  if  the 
battery  state  of  charge  crosses  the  allowable  boundary,  its  charging 
process  should  be  stopped. 

The  general  form  of  storage  dynamic  with  respect  to  state  of 
charge  definition  is  as  follows 


bound  (provide  a  margin  for  safety)  and  a  lower  bound  (to 
overcome  power-conversion  Inefficiency  of  buck-boost  converter 
in  extremely  low  voltage  conditions)  is  defined  as  practical 
limits  [30]. 


v.-i.R  -v  =  0  =>  P  -  i.2R  -  i.v  =0  ro\ 

t  t  s  c  t  t  s  t  c  (  o  ) 

I _ I  I _ I  I _ I  K  J 

Terminal  Series  Loss  Storage  Element 

The  above  quadratic  equation  which  is  applicable  to  both  bat¬ 
tery  and  ultra-capacitor  elements,  has  two  solutions  for  current  as 
follows: 


SOCe  [Smjn,  5max] 


(6) 


5.3.2.  Charge  sustenance 

Charge  sustenance  means  the  net  energy  consumption  in  the 
buffer  in  a  complete  driving  cycle  is  zero,  that  is,  the  energy  level 
in  the  storage  at  the  beginning  and  the  end  of  the  driving  cycle  is 
the  same.  In  contrary  “charge  depletion”  means  maximum  battery 
usage  (plug-in  vehicle).  The  buffer  charge  sustaining  constraint 
should  be  included  in  optimal  power  management  problem.  It 
does  provide  the  ability  to  benchmark  and  compare  various  con¬ 
trollers,  in  other  word  the  storage  does  not  make  any  contribution 
in  vehicle  power  supply,  but  it  only  serves  as  an  intermediate 
device  for  saving  and  loading  of  energy.  To  compare  a  real-time 
controller  with  the  optimal  solution,  the  final  value  of  state  of 
charge  obtained  from  the  optimal  solution  should  be  replaced 
with  final  value  of  state  of  charge  in  a  real-time  controller.  In  fact, 
little  changes  in  the  final  state  of  charge  value  may  lead  to 
widespread  use  of  battery. 

Of  course,  in  the  real-time  controllers  this  constraint  is  consid¬ 
ered  too  to  avoid  the  frequent  charge  and  discharge  of  battery.  In 
most  of  the  studies  related  with  real-time  control  topic,  state  of 
charge  has  been  controlled  within  specific  range.  In  some  cases  like 
[11]  a  reference  signal  has  been  used,  which  has  a  maximum 
(stopped  vehicle  has  no  ability  to  store  regenerative  braking  en¬ 
ergy)  and  minimum  (vehicle  driving  at  maximum  speed  has  no 
chance  to  receive  more  energy  to  accelerate)  limits. 

5.3.3.  Storage  dynamic 

The  equivalent  circuits  of  hybrid  storage  elements  are  shown  in 
Fig.  3  which  has  many  features  in  common.  Based  on  “motoric 


Table  3 

Parameters  of  electric  machine. 

Permanent  magnet  (PMS) 

Nominal  power  Pn  32  kW 

Efficiency  bound  r/m  20-92% 


-f'oc  ±  \Jv oc  +  4RsPt  _  vc  If  Vc  \  2  Pt 

2 Rs  ~  ~2RS  V \2RS)  +TS 


(9) 


where,  vc  is  the  voltage  of  storage  element.  By  determining  fraction 
of  terminal  current  allocated  for  energy  storage  element  and 
rewriting  in  terms  of  state  of  charge,  the  dynamic  of  system  is 
determined. 


5.4.  Battery 

Because  of  complexity  in  chemical  reactions  of  battery,  it  is 
difficult  to  develop  a  model  based  on  its  physical  phenomena  that 
can  predict  transient  behavior. 

In  this  paper,  the  simple  model  of  equivalent  RC  circuit  is  used  as 
shown  in  Fig.  3,  which  consists  of  an  ideal  voltage  source  (open 
circuit  voltage)  and  an  internal  resistance,  and  characteristic  curve 
of  this  two  element  for  a  simple  cell  shown  in  Fig.  4  [31  ].  Since  the 
internal  resistance  depends  on  current  direction,  there  are  two 
different  curves  for  charge  and  discharge  situation. 

Based  on  Table  4  [20],  the  capacity  of  battery  bank  is  as  follows: 

E  =  (NsVr)(JVpQah)  =  4  x  12  x  26/1000  =  1.248  kWh  (10) 


5.4.1.  Equation  of  model 

To  determine  battery  dynamic,  the  circuit  current  from  equation 
(9)  substituted  in  state  of  charge  equation. 

=  ~trs  ±  \J  (sfe)  +  § 

{Q  =  NpQ,  Voc  =  JVsVoc,  Rs 

The  above  equation  is  a  battery  dynamic  model  in  the  general 
form  of  relationship  (7).  Since  the  state  variable  does  not  in  the 
right  hand  side  of  the  equation,  battery  dynamic  is  a  simple 
integrator. 


(ID 
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Fig.  3.  Equivalent  circuit  of  battery  and  ultra-capacitor. 


Fig.  4.  Variation  of  open  circuit  voltage  and  internal  resistance  as  a  function  of  charge  level. 


5.5.  Ultra- capacitor 

In  most  of  the  researches  on  power  management,  ultra¬ 
capacitor  modeled  using  equivalent  circuit  and  normally  a  first- 
order  [32]  or  second-order  [33]  models.  Here  an  equivalent  cir¬ 
cuit  model  presented  in  Fig.  3  used  which  consists  of  a  capacitor,  a 
series  resistance  (resistance  against  the  charge  and  discharge)  and 
a  parallel  resistance  (overall  leakage). 


5.5.1.  Equation  of  model 

In  order  to  determine  the  dynamic  equation  of  model,  first  KCL 
was  applied  on  connecting  node  of  circuit  elements  and  then 
substitute  terminal  current  from  equation  (9). 


ic  +  ip  -  it  => citVc  +  Rp  ~  Zt 


Sc  =  3^-  =  =  ScFmax  (13) 

Cdmax  Cfmax 

The  dynamic  equation  of  ultra-capacitors  obtained  by 
combining  equations  (12)  and  (13),  which  is  in  the  general  form  of 
equation  (7).  This  equation  represents  a  first-order  nonlinear 
system. 


C^c  -  (2k  +  rJSc  ±  2RS  Pt 

{c  =  "fc  Rs  =  %RS,  R~p  =  %Rpj 


(14) 


Based  on  the  data  represented  in  Table  5  [34],  the  capacity  of 
ultra-capacitor  bank  is  as  follows: 


E 


1 

2 


(NsVr)2 


0.5  x  (2/9)  x  500  x  (9  x  16)2 
1000x3600 


0.32  kWh 
(15) 


By  assuming  constant  capacitor  coefficient,  the  state  variable 
(state  of  charge)  is  as  follow: 


5.6.  Fuel  cell 


Table  4 

Battery  parameters. 


Valve-regulated  lead  acid  battery 

Nominal  voltage 

Vr 

12  V 

Coulombic  efficiency 

V 

90% 

Charge  capacity 

Qah 

26  Ah 

Internal  resistance  (average) 

^chg)  ^dis 

28.9,  20.9  mQ 

Bank 

NS)Np 

4,  1 

Fuel  cells  have  various  types  which  normally  categorized  in 
terms  of  their  electrolyte.  One  of  these  types  that  widely  used  in 
vehicle  propulsion  system  is  Polymer-Electrolyte  Proton  Ex¬ 
change  Membrane  (PEM)  [35].  According  to  multi-disciplinary 
nature  of  fuel  cell,  there  are  different  modeling  approaches  in 
literature  with  different  level  of  complexity.  It  is  common  to  use 
quasi-static  models  of  fuel  cell  in  energy  management  application 
and  it  assumed  to  be  well-regulated,  to  operate  in  nominal 
conditions. 
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Table  5 

Ultra-capacitor  parameters. 


Maxwell  BMOD0500B01 

Capacitance 

C 

500  F 

Rated  voltage 

Vr 

16  V 

Internal  resistance 

Rs 

2.1  mQ 

Leakage  current 

h 

5.2  mA 

Bank 

NS)Np 

9,2 

To  avoid  complex  thermodynamic  and  electrochemistry  equa¬ 
tions,  an  efficiency-based  model  used  for  fuel  cell,  which  can 
describe  common  types  of  fuel  cells  and  its  goal  is  to  calculate  fuel 
consumption  from  requested  power  (the  inverse  of  model  shown  in 
Fig.  5).  For  sake  of  simplicity,  the  internal  phenomena  like  activa¬ 
tion,  mass  transport  over  potential  and  internal  resistance  of  fuel 
cell  were  ignored.  There  is  no  bound  considered  on  stack  variables 
like  current,  voltage  and  temperature. 


5.6.1.  Fuel  consumption 

In  initial  estimates,  the  fuel  cell  efficiency  is  defined  based  on 
Gibbs  free  energy,  Flelmholtz  function  and  enthalpy  [35],  which 
depends  on  fuel  cell  reactions  type.  According  to  fuel  cell  structure 
shown  in  Fig.  5,  the  fuel  processing  and  its  irreversibly  affect  effi¬ 
ciency  and  also  a  fraction  of  power  produced  supplied  to  auxiliaries 
equipment  mostly  related  to  the  air  compressor.  Flere  the  fuel  cell 
data  adapted  from  ANL50H  model  of  Advisor  library.  Having  effi¬ 
ciency  curve  of  fuel  cell  shown  in  Fig.  6,  consumption  rate  and  its 
specific  fuel  consumption  determined  [30]. 


mH2 


Pfc 

y(PfC)  x  lhvH2 


(16) 


Here  fuel  consumption  measured  in  unit  of  equivalent  gasoline 
liter  per  100  km.  If  vehicle  traveled  x  meters  along  a  driving  cycle 


and  consumed  y  grams  of  hydrogen,  the  gasoline  equivalent  con¬ 
sumption  based  on  LHV  is  as  follows  [36]: 

FC  =  378.54(y/x)  [Gasoline  Equivalent  L/100  km]  (17) 


5.7.  Final  model 

By  assembling  all  of  described  sub  models  and  implemented  in 
MATLAB,  the  final  is  derived  in  an  analytical  viewpoint,  the 
nonlinear  state  space  representation  of  final  model  is  as  follows: 

it(t)  =  F(7(t),T?(t),w(t))  (18) 

Since  there  are  two  storage  elements  in  this  research,  system 
dynamic  model  consist  of  two  state  variables  (x)  corresponding  to 
battery  and  ultra-capacitor  charge  and  two  control  inputs  (u)  are 
the  fuel  cell  and  ultra-capacitor  power.  The  driving  cycle  considered 
as  a  priori  known  exogenous  variable  (w). 

The  number  of  control  variables  can  be  reduced  by  augmenting 
a  sample  value  to  control  array  and  thereupon  removing  one 
dimension  of  the  problem.  For  instance,  the  (-1)  can  be  used  to 
represent  primary  source  on/off  state.  This  is  suitable  in  such  cases 
that  control  variables  are  dependent  on  each  other  (i.e.  the  input  to 
mechanical  brake  and  primary  power  source  do  not  activated 
simultaneously),  and  they  should  be  considered  in  a  multi¬ 
dimensional  framework  if  they  were  independent. 

6.  Optimal  supervisory  control 

The  supervisory  control  is  a  top-level  structure  that  provides 
control  signals  required  for  system  resources.  This  request  feeds  as 
a  reference  signal  to  low-level  controllers  and  it  would  be  provided 
by  ideal  regulators  and  proper  servo-loops. 


Fig.  5.  Structure  of  fuel  cell  (forward  model). 


Net  Power  [kW] 


Net  Power  [kW] 


Fig.  6.  Characteristic  curve  of  fuel  cell. 
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In  this  section,  firstly  the  optimal  supervisory  control  of  energy 
management  is  formulated  with  respect  to  the  final  vehicle  model 
and  then  solved  using  dynamic  programming.  Fig.  7  illustrates  the 
overall  structure  of  problem.  Finally,  the  problem  was  simulated  in 
various  driving  cycles,  and  potential  of  utilizing  hybrid  storage  on 
the  vehicle  performance  is  investigated. 

6.1.  Formulation  of  dynamic  optimization 

In  most  of  simple  models  used  in  the  offline  management  of 
energy  in  hybrid  vehicles,  the  storage  charge  level  is  the  only  state 
of  system.  Generally  the  dynamic  which  needs  to  be  controlled  or 
affects  the  cost  function  and  constraints  should  be  considered  as 
state  variable  in  dynamic  programming.  Because  of  the  charge 
sustaining  constraint  in  hybrid  vehicles,  the  storage  charge  level 
will  be  considered  as  state  variable  in  dynamic  programming.  Note 
that  if  the  charge  sustaining  constraint  omitted  and  no  boundary 
limits  on  state  of  charge  then  there  is  no  need  to  include  storage 
dynamics. 

In  this  paper,  a  vectorized-high  performance  dynamic  pro¬ 
gramming  code  is  used,  but  the  powertrain  model  should  be 
simplified  enough,  because  the  computational  cost  associated  with 
multi-control  multi-state  is  still  a  deterrent  factor  in  the  application 
of  dynamic  programming. 

6.1.1.  General  formulation  of  optimal  control 

The  profile  of  optimal  control  problem  studied  in  this  paper  are 
as  follow:  constant  time  interval,  multi-state  multi-control,  con¬ 
stant  initial  and  desired  final  state,  fixed  definition  interval  of  state 
and  control  variables,  a  priori  known  disturbance.  These  charac¬ 
teristics  can  be  summarized  in  following  formulation: 

tf 

Cost  Functional  J  =  +  j  £(x(t),  u(t),  i)di 


to 


Optimal  Control 

u'(t)  =  argminj(x0,  u(t)) 

u(t) 

System  Dynamics 

(x(t)  =  F(x(t),u(t),t) 

Boundary  Condition 

r  x(t0)  =  x0 
jx(tf)  =  xf 

Admissible  Set 

f  X(t)eir(t)clRn 
\u(t)e  ^(t)clRm 

6.1.2.  Cost  components 

In  vehicle  design  consideration,  there  should  be  a  harmony 
between  drivability  and  fuel-related  (consumption  and  pollution) 
criteria  and  no  one  sacrificed  for  other.  Of  course  the  weighting 
factor  for  mentioned  indicators  depends  on  the  vehicle  class. 
Therefore  there  is  more  attention  to  fuel  considerations  in 
economical  cars  which  mostly  work  in  the  traffic  cycles,  while  in 
the  sports  car,  performance  is  weighted  more.  In  this  research, 
based  on  software  implementation  considerations,  the  cost  func¬ 
tion  divided  into  three  components:  boundary  component  (charge 
sustenance),  instantaneous  component  (fuel  consumption),  and 
rate  component  (frequency  of  fuel  cell  operation). 


Fig.  7.  Structure  of  dynamic  optimization. 


The  satisfaction  of  charge  sustenance  is  a  big  challenge  in  energy 
management  problem,  and  here  it  is  implemented  as  a  “soft” 
constraint,  i.e.  a  penalty  added  to  cost  function  based  on  charge 
difference  from  desired  final  value.  Also  another  component  added 
to  cost  to  decrease  frequency  of  fuel  cell  operation  (reduce  frequent 
fuel  cell  turning  on  and  off)  [37].  The  implementation  of  this  term  is 
complicated  because  it  requires  knowledge  of  input  at  both  side  of 
each  step. 

The  main  component  of  the  cost  function  is  fuel  consumption  of 
primary  source  (hydrogen).  So  it  is  clear  that  by  utilizing  the  inte¬ 
grator  model,  the  storage  element  has  higher  priority  in  energy 
delivering,  unless  the  demand  power  exceed  the  maximum  storage 
capability  or  the  state  of  charge  reaches  to  its  limitation  boundaries, 
which  the  main  power  source  comes  to  share. 

6.2.  Dynamic  programming 

Dynamic  programming  is  a  powerful  method  for  the  numerical 
solution  of  dynamic  optimization  problems  [6].  Optimal  control  is 
a  part  of  this  family  and  the  use  of  dynamic  programming  to  solve 
these  kinds  of  problems  has  been  widely  studied  in  the  literature 
[38].  This  method  can  be  applied  to  deterministic  as  well  as  sto¬ 
chastic  problems  and  simply  deal  with  nonlinear  dynamics  and 
constraints  and  guarantees  achievement  of  global  optimality 
(provided  the  solution  exists).  In  this  method,  firstly  the  problem 
must  be  discretized  (partitioning  time,  state  and  control  variables 
as  in  Fig.  8).  So  there  is  only  finite  amount  of  possible  solutions. 
This  algorithm  only  searched  a  part  of  the  acceptable  solution 
within  all  possible  solution  space  using  “Bellman  principle  of 
optimality”. 

In  this  section  the  formulation  of  dynamic  programming  sum¬ 
marized  for  solving  optimal  control  problems  based  on  the  notation 
presented  in  Ref.  [39].  See  Ref.  [27]  for  theoretical  principles  and 
formulation. 


i(Xbt>Xuc,  Ufc,  Uuc)  =  Wbt(xj 


-  wuc 


(x! 


-X,1, 


Battery  Ultra  Capacitor 

V 

Charge  Sustaining  Penalty 


At  Y)  rhf(u{c)  +  A  Y  (Sign  (u£)  -  Sign  (u^ )  )  2 

^  v  ^  ^  v  ^ 

Fuel  Cell  Consumption  On/Off  Frequency 


(20) 
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The  discrete  formulation  of  dynamic  programming  is  based  on  a 
recursive  relationship  with  specified  initial  condition. 


Vx  e  XM 


k  =  {N- l,  — ,2,1} 


Vx  e  X, 


*  J N  (XX  )  ~  £  (XiV  )  | 

•Jk{xA  =  mi.n  {4  (xt,ut  )  +  Jt+1  (. xt+1 )}  I 

uk  £L4k 


(21) 


In  above  recursive  relation  J/c  is  called  “Cost  to  Go”  map  or  value 
function,  which  for  every  point  of  state-time  space  (x/<)  gives  the 
cost  to  move  on  optimal  trajectory  from  that  point  to  final  time. 
Also  Uk  is  optimal  control  for  the  departure  from  this  point  to  the 
next  step  on  optimal  trajectory. 

This  map  is  usually  implemented  as  a  lookup  table.  To  deter¬ 
mine  the  optimal  trajectory  corresponding  to  a  specific  point  in 
state-time  space,  it  is  sufficient  to  determine  the  corresponding 
optimal  control  and  then  solving  system  dynamics  to  obtain  next 
point  on  the  optimal  trajectory.  Now  repeating  this  process  toward 
the  final  Time,  the  system  trajectory  and  series  of  optimal  control  is 
determined. 

6.2.1.  Code-vectorized  development 

Although  the  dynamic  programming  heavily  reduces  the 
computational  cost  of  determining  the  optimal  solution  in  com¬ 
parison  to  direct  search,  however,  its  application  in  energy  man¬ 
agement  problems  in  long  cycles  and  including  multi-state  multi¬ 
control  variables  is  associated  with  difficulty.  Guzzella  presented  a 
complete  structure  for  definition  of  dynamic  programming  algo¬ 
rithm  and  standardized  the  definition  of  the  problem,  the  data 
structure  and  required  routine  [39]  and  this  paper  will  follow  this 
conventions. 

MATLAB  package  have  optimal  routines  for  matrices- 
development  algorithms,  which  the  significant  improvement  in 
performance  obtained  by  eliminating  iterative  and  loop  structures. 


Because  the  energy  management  problem  includes  high  amount  of 
iterated  matrix  algebra,  the  vectorized  formulation  of  the  code  will 
heavily  improve  its  performance.  Unfortunately  there  is  no  inte¬ 
grated  works  in  this  fields  presented  in  literature.  Among  the 
existing  works,  only  [37]  noted  to  vectorization  of  dynamic  pro¬ 
gramming  code  to  improve  the  computational  performance.  Also  in 
Ref.  [27]  the  general  format  of  vectorized  pseudo-code  of  dynamic 
programming  presented. 

In  conventional  dynamic  programming,  three  loops  over  time 
stage,  state  variables  and  control  are  required  [27].  Using  ad¬ 
vantages  of  the  code-vectorization,  loops  on  the  state  variables 
and  control  can  be  eliminated.  Elimination  of  these  loops 
improved  significantly  computational  performance,  but  need 
higher  memory  allocation.  In  fact,  a  loop  consisting  of  a  series  of 
repetitive  operations  on  elements  of  an  array  based  on  its  index. 
In  vectorized  version,  all  operations  on  elements  performed  in 
one  step. 


7.  Simulation  and  evaluation 

In  this  study,  the  maximum  potential  of  using  hybrid  storage  on 
fuel  consumption  is  determined  relying  on  model-based  approach. 
In  this  regard,  firstly,  the  assembled  model  is  discretized.  Then 
using  deterministic  multi-dimensional  dynamic  programming,  the 
optimal  energy  management  solution  corresponding  to  minimum 
fuel  consumption  is  achieved. 

To  demonstrate  the  applicability  of  developed  tool,  three  vehicle 
arrangements  used  including  “No  Storage”,  “Single  Storage”  and 
“Hybrid  Storage”.  The  first  layout  is  similar  to  a  conventional 
combustion  vehicles  except  the  internal  combustion  engine 
replaced  by  fuel  cell  power  supply  and  since  there  is  no  storage 
system,  the  brake  energy  cannot  recovered  and  the  driving  demand 
of  cycle  is  fully  propelled  by  fuel  cell.  The  parameters  of  dynamic 
programming  solver  are  represented  in  Table  6. 

The  convention  of  power  flow  used  in  following  graphs  pre¬ 
sented  as  follow.  Based  on  Fig.  1,  the  positive  road  power  demand 
corresponds  to  power  request  from  power  supply  elements  (i.e.  in 


Fig.  8.  The  dynamic  programming  search  pattern  in  each  time  stage. 


Table  6 

Parameters  of  dynamic  programming. 
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Dynamic  programming  algorithm 

Single 

NX,NU 

81,  51 

Multiple 

^x(bt.uc) 

81,41 

Nu(fc,uc) 

51,  41 

Interpolation 

J,U 

pchip,  linear 

accelerating  or  uphill  climbing).  Based  on  motoric  references, 
positive  buffer  power  corresponds  to  charging.  By  considering 
these  two  convention,  the  prime  mover  power  (fuel  cell)  is  positive 
only  (deliver  power).  To  properly  present  graphs,  the  negative  of 
fuel  cell  power  is  utilized  to  avoid  curves  conflict. 

The  simulation  results  for  the  three  specified  vehicle  arrange¬ 
ments  presented  in  two  parts:  “time  results”  and  “statistical  re¬ 
sults”  as  follow. 

7.1.  Time  analysis  of  the  optimal  solution 

Time  results  including  time  response  of  model  variables  pre¬ 
sented  for  ECE-15  driving  cycle,  which  used  to  demonstrate  perfor¬ 
mance  of  developed  tool  and  provide  intuition  understanding.  Fig.  9 
represents  speed  and  acceleration  (green  stair- wise  curve)  of 
mentioned  driving  cycle.  The  horizontal  bars  on  left  show  the  speed 
frequency  and  density,  indicating  the  concentration  of  specified 
driving  cycle  in  different  speed  regions.  Alongside  with  driving  cycle, 
the  time  history  of  vehicle  variables  is  presented  in  Figs.  10-12.  In 
each  arrangement,  the  colored-bands  in  driving  cycle  plot,  used  to 
distinguish  between  pure  activity  of  primary  (orange  color  in  web 
version,  pure  hydrogen-propelled)  and  secondary  (green  color  in 
web  version,  pure  electric-propelled)  source.  In  Fig.  10  the  result  of  a 
fuel  cell  electric  vehicle  without  storage  buffer  is  shown.  Since  there 
is  no  recovery  of  braking  energy,  this  vehicle  has  higher  fuel  con¬ 
sumption.  In  Figs.  11  and  12  the  result  of  hybrid  fuel  cell  vehicle  is 
shown.  The  Power  plot  corresponds  to  optimal  energy  management 
control  input,  which  shows  power  distribution  between  different 
power  sources.  The  SOC  plot  reflects  state  variables  corresponding  to 
selected  vehicle.  As  can  be  seen,  the  charge  sustenance  satisfied  very 
well. 

The  histograms  of  fuel  consumption  vs.  power  are  normally 
used  to  show  characteristics  of  fuel  cell  operation  [30,36].  Accord¬ 
ing  to  Fig.  13,  the  optimal  strategy  tries  to  concentrate  the  density  of 
the  fuel  cell  operation  around  the  optimum  fuel  consumption  point 
(approximately  20  kW).  In  this  figure,  the  mean  and  standard  de¬ 
viation  (p  &  a)  of  fuel  cell  operating  point  is  shown. 

7.2.  Statistical  analysis  of  the  optimal  solution 

Statistical  results  are  a  convenient  way  to  compare  the  perfor¬ 
mance  between  single  and  hybrid  storage,  which  the  resultant  fuel 
consumption  for  different  configurations  of  vehicles  has  been 
presented  for  four  driving  cycles,  NYCC,  EUDC,  SFTP  and  NEDC.  A 
comparison  of  minimum  fuel  consumption  (gasoline  equivalent 


Fig.  10.  Response  of  fuel-cell  only  vehicle. 
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Fig.  11.  Response  of  fuel-cell  hybrid  vehicle  with  single  storage  system. 


liter  per  100  km)  between  these  two  arrangements  in  different 
cycles  is  shown  in  Fig.  14. 

Here  are  two  rules  to  better  justify  the  results  presented  in 
Fig.  14.  Rule  1 :  The  recovery  of  the  braking  energy  is  the  main  factor 
that  distinguishes  between  the  “No  Buffer”  layout  and  the  other 
two  layouts;  as  the  latter  could  recover  the  braking  energy  using 
their  storage  buffer.  As  the  figure  shows,  there  is  a  significant 
improvement  in  the  hybrid  operation  from  the  NYCC  driving  cycle 


Fig.  9.  ECE  manual  transmission  city  driving  cycle. 


Fig.  12.  Response  of  fuel-cell  hybrid  vehicle  with  hybrid  storage  system. 
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Fig.  13.  Histogram  of  fuel-cell  operation  with  single  and  hybrid  storage  system. 


Driving  Cycle 

Fig.  14.  Potential  fuel  consumption  improvement  in  various  driving  cycles. 


due  to  the  high  energy  fraction  of  the  braking.  Rule  2:  The  ultra¬ 
capacitor  has  a  low  energy  content,  so  it  could  not  contribute  to  the 
energy  of  the  buffer,  but  since  it  has  a  high  power  absorption 
capability,  it  could  help  in  the  high  power  section  of  the  driving 
cycle.  As  the  figure  shows,  the  ultracapacitor  tends  to  somewhat 
decrease  the  fuel  consumption  in  all  cases.  It  could  be  seen  that  in 
the  ECE-15  cycle  which  is  a  relatively  smooth  cycle,  the  ultra¬ 
capacitor  approximately  made  no  difference;  whereas  in  the  EUDC, 
SFTP  and  NEDC  cycles  with  more  accelerations  and  decelerations, 
the  ultracapacitor  made  more  difference. 

7.3.  Validation  of  algorithm 

Due  to  lack  of  experimental  data,  it  is  not  possible  to  fully 
validate  numerical  accuracy  of  presented  model,  meanwhile  the 
developed  algorithm  is  evaluated  by  using  different  scenarios.  To 
evaluate  developed  algorithm  and  assess  numerical  aspect,  the 
scenario  of  removing  the  charge  sustenance  constraint  is  used.  By 
removing  this  constraint  and  using  integrator  model  (for  storage 
elements)  and  assuming  sufficient  battery  capacity,  the  optimal 
solution  is  focused  on  excess  use  of  batteries.  Another  scenario  that 
can  be  imagined  is  maximization  of  objective  function.  In  this  case, 
unlike  the  first  scenario,  the  optimal  solution  is  focused  on  use  of 
fuel  cell  more  than  storage  element.  The  results  of  simulation  while 
removing  charge  sustaining  certify  the  accuracy  of  general  logic  of 
simulation. 

7.4.  Computational  load  comparison 

To  demonstrate  the  performance  of  developed  code,  the 
computational  cost  associated  with  simulation  of  vehicle  equipped 


with  single  and  hybrid  storage  in  two  different  cycles  presented  in 
Table  7.  According  to  calculations  time,  it  is  clear  that  the  compu¬ 
tational  load  compared  with  those  reported  in  the  literature  [23,24] 
is  extremely  lower.  This  proves  the  advantages  of  the  code- 
vectorized  implementation. 

Characteristics  of  computer  used  in  this  research  shown  in 
Table  8.  Due  to  functional  structure  overhead  and  graphical  controls 
update,  the  pure  computational  load  is  less  than  amount  reported. 

Also  be  careful  with  grid  partitioning  of  state  and  control  vari¬ 
ables,  which  demands  for  more  memory  request  and  for  example 
the  network  with  more  than  200  divisions  required  about  6  GB  of 
memory,  and  allocation  of  such  amount  of  memory  in  32-bit 
platform  is  a  challenging  issue. 


Table  7 

Computational  cost  comparison. 


Cycle 

Algorithm 

Time  (s) 

Grid  X  x  U 

ECE 

Single 

12 

100  x  100 

Multiple 

235 

(60,30)  x  (60,30) 

NYCC 

Single 

28 

100  x  100 

Multiple 

712 

(60,30)  x  (60,30) 

Table  8 

Characteristics  of  computer  software. 


Hardware 

Software 

CPU 

Core2Quad 

OS 

Windows  7 

2.8  GHz 

X64 

Memory 

6  GB 

MATLAB 

201 OA 
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8.  Conclusion 

The  optimal  energy  management  of  a  fuel-cell  hybrid  vehicle 
with  hybrid  storage  investigated  on  a  model-based  approach.  In 
this  problem,  a  vehicle  traveled  along  a  priori  known  driving  cycle. 
The  objective  function  has  two  components:  fuel  consumption  and 
charge  sustenance.  This  problem  has  two  state  variables  and  two 
corresponding  degrees  of  freedom  in  power  distribution,  so  it  was 
solved  using  multi-dimensional  dynamic  programming.  The 
research  goal  is  to  determine  the  maximum  potential  of  using 
hybrid  storage  in  reducing  fuel  consumption. 

The  problem  was  simulated  in  different  driving  cycles  to 
provide  comparing  the  minimum  fuel  consumption  between 
two  arrangements:  single  storage  and  hybrid  counterpart.  The  re¬ 
sults  indicate  improvement  in  fuel  consumption  in  presence  of 
ultra-capacitor,  because  the  deficiency  of  battery  as  a  slow-storage 
is  compensated  by  ultra-capacitor.  The  strong  pulses  of  power 
could  be  absorbed  by  ultra-capacitor,  so  the  hybrid  storage  has  a 
large  impact  on  acceleration  performance  and  braking  recovery. 

The  general  format  of  optimal  energy  management  solution  in 
the  described  problem  mainly  depends  on:  dominant  weight  of  fuel 
consumption  in  objective  function,  the  point  of  maximum  effi¬ 
ciency  in  fuel-cell  performance  curve,  and  characteristics  of  model 
used  for  storage  elements.  If  simple  integrator  model  is  used  for 
storage  elements,  then  the  nature  of  the  optimal  solution  is  of 
bang-bang  type  (fuel  cell  frequent  on-off  around  optimal  efficiency 
point).  If  storage  lossy  model  is  used,  the  optimal  solution  tries  to 
make  a  balance  between  optimal  operation  of  fuel  cell,  storage 
element  and  demand  power,  because  in  this  situation  the  zero 
power  relates  to  optimal  operating  point  of  storage  while  the  fuel 
cell  has  low  efficiency  in  low  power  region.  The  proper  sizing  of 
components  has  a  great  impact  on  performance  of  hybrid  vehicle. 
This  is  well  beyond  the  scope  of  this  paper  and  it  is  suggested  that 
the  battery  and  ultra-capacitor  be  sized  based  on  optimal  energy 
management  and  represents  the  impact  on  fuel  consumption.  The 
satisfaction  of  charge  sustenance  constraint  strongly  affects  the 
optimal  solution  and  small  deviations  may  tend  to  wide  storage 
use.  To  provide  a  proper  framework  for  design  study  and  accurate 
comparison,  the  deviation  from  this  constraint  should  be  reduced. 
This  is  important  in  the  present  study,  since  it  must  be  considered 
for  both  battery  and  ultra-capacitor  simultaneously. 

Due  to  lack  of  systematic  study  in  context  of  optimal  energy 
management  solution  in  hybrid  storage  application,  it  is  suggested 
that  future  studies  concentrate  on  the  application  of  algorithms 
such  as  iterative,  stochastic  and  approximate  dynamic  program¬ 
ming  and  Pontryagin’s  principle,  and  the  performance  and 
computational  cost  is  presented.  Since  there  is  no  well- 
documented  statistical  information  on  manufacturing  cost  and 
hardware  implementation,  field  studies  providing  such  informa¬ 
tion  in  the  field  of  hybrid  storage  systems,  can  help  to  investigate 
the  balance  between  cost  imposed  on  vehicle  and  improvement  in 
vehicle  fuel  consumption. 

The  developed  code  and  its  user  interface  are  placed  freely  in 
the  address  (sites.google.com/site/ansarey)  in  order  to  allow  re¬ 
searchers  use  it  for  future  development  and  generalize  the  software 
and  its  components  library. 
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